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TECHNICAL NOTE 2939 

OPTIMUM CONTROLLERS FOR LINEAR CLOSED-LOOP SYSTEMS 

By Aaron S. Boksenbom, David Novik 
and Herbert Heppler 


SUMMARY 

An analysis for optimum controllers of general, linear, time- 
invariant mnltiloop systems is presented. Opt imi zation is based on 
minimizing mean- square or integral- square errors for either stationary 
statistical or transient inputs, with limits and constraints of mean- 
or integral- square form. General representations of controller char- 
acteristics, stable process characteristics, and error relations are 
used. A method is shown of assuring stability of the multiloop Bystem 
during the optimization process and casting the multiloop controlled 
system into an equivalent open loop so that. the methods of optimum fil- 
ter theory can be used. General solutions are obtained for four special 
cases. Two examples for speed control of a turbojet engine illustrate 
the methods developed in this report. The data for a controlled turbo- 
jet engine were in substantial agreement with the theoretical results. 


INTRODUCTION 

One of the fundamental functions of controllers is the reduction 
of certain variables, called errors, to small values. This must be 
accomplished with the dynamical nature of the system, the difficulty 
of accurate measurement, the power requirements to manipulate valves, 
and so forth, the random effects at the inputs, and the general 
effects of noise taken into consideration. At various stages in the 
design of an over-all controlled system, the question arises as to 
what computations the controller should make to minimize the errors. 

In this report, the problem of optimizing this computations.] aspect 
of the controller is analyzed. Linear systems are assumed throughout. 
Optimization is considered under either transient or statistical inputs 
and disturbances and is based on the minimization of mean- square errors 
or integral- square errors. Constraints and limits are included as mean- 
square or integral-square values. 
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Most investigations in this field optimize the controlled system 
by adjusting certain parameters of an otherwise fixed system. In this 
report the more general, approach of optimizing the system by adjusting 
the--entire frequency-response characteristics of the controllers is 
used. This general approach was first developed in reference 1 for 
the design of filters, and a corresponding development is presented 
herein for a closed-multiloop controlled system. New problems of 
structural, stability and physical realizability arise in the closed- 
loop cases. In addition, necessary constraints and limits are included 
in this analysis. 

The problem of opt imi zing the computational aspect of the control- 
ler is first reduced to a standard form by generalizing the frequency- 
response characteristics of both the process to be controlled and the 
controller, the conditions of stability, and the specifications on 
errors, constraints, and limits. The general solution for the optimum 
controllers giving an absolute minimization of errors is derived. In 
addition, the expressions for the minimum errors, and the additional 
errors suffered when nonoptimum controllers are used, are shown. 

It Is expected that the results of this analysis, conducted at 
the MCA Lewis laboratory, can be used as a basis for controller design, 
as a standard under which controllers can be evaluated, or as a possible 
basis of specifications on controller dynamics. Applications of the 
results of this analysis to several examples of controlling gas turbine 
engines are shown. 


SYMBOLS 

The following symbols are used in this report: 
a engine or- fuel servo dead time 

b,c constants for describing spectral densities of inputs 

C general linear operators representing controller 

E stable linear operators representing engine or process 

e errors to be minimized by control and constrained variables 

e* errors resulting from nonoptimum controller 

F,G stable linear operators representing parts of controller 

general linear operators giving response of errors 


H 
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K loop gain 

R arbitrary stable linear operators 

t time 

v inputs and disturbances affecting errors 

x manipulated variables 

y inputs to controller 

z inputs and disturbances affecting y's 

6F arbitrary stable linear operators 

X Lagrangian multiplier 

cs engine time constants 
Tj integral time constant 

cu frequency 

Subscripts: 

j,n,r,s,v summation, indices 
opt optimum 

Superscripts: 


complex conjugate 

expected value or integral 

Correlation function notation: 

For statistical inputs, 

P® 


( v j z v) = (Vi) = on 


v" j ' 


2ir 


Zy( t ) W j( t + U ) 


-iXDU , 

e du 


^,/ U =-00 


For transient inputs, 
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(wjz v ) = ~ Wj(t) 6“ imt at 

K*/-o o 

- (v 3 z v ) 

Matrix notation: 

E ... indicates element of j t31 row, k th column of matrix E 

jk 

ANALYSIS 

Scope of Analysis 

The scope of the analysis is summarized as follows: 

1. T ime -invari an t linear systems are assumed throughout. 

2. The process to he controlled is inherently stable, with one 
variable to be manipulated by the controller. 

3. Optimization is to be realized for either transient or station- 
ary random inputs. 

4. Optimization is based on minimizing mean-square or integral- 
square errors. The constraints and limits of the system are included 
by constraining the mean-square or integral- square values of the vari- 
ables involved. 

5. Complete freedom in computation is assumed for the controller. 

The same formal equations in the time domain are obtained for the 
nonstationary, time-varying cases as for the stationary, time -invariant 
cases (ref. 2)j but, even for the open-loop filter problem, the equa- 
tions for the time-varying cases can be solved only by numerical means. 
Extension of the analysis of this report' to the time -varying cases would 
require such techniques as those in reference 2. The linear assumptions 
do not completely preclude- application of the methods of this report to 
nonlinear systems. Many nonlinearities can be handled so as to allow 
linear techniques without omitting the essential nature of the nonline- 
arity (refs. 3 and 4). 

When the process to be controlled is inherently unstable, the 
techniques of preserving stability of the closed-loop system are more 
involved anri these rather uncommon cases are not treated herein. The 
extension of this analysis to cases having several manipulated variables 
follows in a straightforward manner, but the final equations to be 
solved are more complex. The fundamental development of these cases 
is shown in the appendix. 
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The optimization problem, for transient inputs is the same as that 
for statistical inputs (ref. 5) if mean squares are replaced by integral 
squares and if spectral densities are replaced by products of Fourier 
transforms, as shown in the list of symbols. The analysis which follows 
was guided by the desire to keep the systems studied and the problems 
resolved as general as possible so that wide applications may be made 
of the results. In order to utilize available open-loop theory, it was 
necessary to determine an open loop equivalent to the actual closed 
loops which would still assure structural stability of the actual sys- 
tem during the optimization procedure. Techniques of accomplishing 
this end were found for those cases of stable process characteristics. 


* 


C har acterization of Process 


The general form of the systems considered is shown in figure 1. 

The time-invariant linear process to be controlled has certain inputs 
~x (in this case only one, such as a fuel-valve position signal) which 
can be and are chosen to be manipulated by the controller. There are 
a certain number of outputs y (such as measured engine speed, meas- 
ured engine speed error, throttle position, altitude pressure, etc.) 
which can be and are chosen to be used by the controller. Each output 
is affected by transient and statistical disturbances and inputs z of 
altitude, air speed, throttle position, and so forth, and by the manipu- 
lated variable through a linear operator E. In general, E would be a 
rectangular array of operators, but for the case of one manipulated 
variable E is a column of operators. The general form of the process 
to be controlled can be written operationally as 

yj = z j + E «J ' x C 1 ) 

This form follows directly from one method of obtaining these char- 
acteristics. If x is held constant, measured y gives the nature of 
z. If x is varied sinusoidally, the harmonic analysis over a large 
number of cycles of measured y filters out any effects of z because 
the harmonic content at any one frequency of either a transient or sta- 
tistical z is relatively small. This can be seen from the following 
analysis: 

If 

x(t) = Re (e tot ) t >0 
= 0 t < 0 

then 

y(t) = z (t ) + Re |e(14o) 


as t->“ 
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and 


where 


and 



T = 


2i± 

CD 


(k is an integer) 


L “►*» 


The first term on the right side of the preceding equation 
approaches zero as k-+°° for either a transient or statistical z , 
and 

L+T 

g -icpt y (t)dt _ E(io>) for L, k-*® 



Characterization of Controllers 

The controller to he designed is to operate on the y*s to give 
x according to the operational equation 

x ■ <2) 

j 

As the optimization of only the computational aspect of the controller 
will he considered, the y’s and the x are outputs and input, respec- 
tively, which isolate the engine or process to he controlled and. which 
can he freely used in computation. 

The C*s of equation (2) are arbitrary linear operators which 
need only to keep the closed-loop system stable . But 7 in order to 
assure stability, the responses of all variables in the system to all 
possible disturbances must be considered. These include variables and 
disturbances internal to the C and E boxes. Because arbitrary 
linear operators can be built up from stable structures and the small 
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internal disturbances of such structures can he considered as applied 
to the input or output as small disturbances, the proper discussion of 
stability should deal only with stable structures. 

The controller operational equation should therefore be written 


x 


£ r J ' y 3 +G 
i 


X 


( 3 ) 


where Fj and G represent stable structures. The only new modes of 

oscillation in the system in addition to the stable modes generated 
by E, F, and G are those represented by the response 

. This criterion of stability can be seen by deriving 

1 - G - FjEj 

i 

the responses of all variables in the closed-loop system to all possible 
disturbances. Each response will have the preceding factor multiplied 
by E, F, or G, or by the sum of the products of these operators. It 
can also be shown that no loss of generality is caused by allowing 


s 



in which case stability of the entire closed-loop system is assured. 
The number of functions F still to be determined is the same as the 
original number of unknown functions C of equation (2). 


There are alternative ways of obtaining the same over-all opera- 
tion expressed by equations (2) or (3), seme of which may be unstable. 
One general method, always stable, is shown by figure 2, in which the 
Fj*s are arbitrary stable structures. 

Combining equations (l), (3), and (4) gives 


x ‘ X Fj ' (5) 

j 

The original closed- loop system of figure 1 is now equivalent to the 
open-loop system of figure 3, and this open-loop system is now compar- 
able with the systems of reference 1, 
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An expression for Cj of equation (2) is 





(5a) 


Specifications on Controller 

The errors to be minimized by the controller are characterized in 
the same way as the y’s as they have a controlled and an uncontrolled 
part. The specif ications_are written 





= a minimum 


( 6 ) 


where 


e J = W J + H j * x 

and H is any general linear operator. 

The X multiplier technique is used to allow additional degrees 
of freedom whenever the optimum values of the errors are not independent 
or when constraints of mean-square form are to be imposed. The X's 
may then appear as parameters of the controller and are adjusted to give 
a compromise among the various dependent errors or to set the mean- 
square values of the constrained variables. 


Minimization of Errors 

From equations (7) and (5), the expressions for the quantities to 
be minimized or constrained are 


= 



“n 


and 



2P 
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+ 


z 


H j F v' 


(z v w i) + 


V 



( 8 ) 


If the symbol F is used for the optimum system resulting in 
error e and the symbol F + 5F is used for any other system resulting 
in error e*, then 



^ l^n( z n z v) 

n 


+ Z x j 




J J 




cko 


8F V Hj(z vWj ) + ]T| Hj | 2 F n ( z n z v) 
v n 



X j 




I Hj i 2 (z v z n ) 5Fv6F n 


v n 


The first two terms of the right-hand side of the preceding equa- 
tion are equal because the integrands are merely conjugate. The third 
term is nonnegative as it is equal to the mean-square error resulting 
when F is 6F and w = 0. Thus the necessary and sufficient condi- 
tion for an absolute minimum is that 



j 


X j 




H j( z v w j) +^|Hj| 2F n( z n z v) 


= 0 


( 9 ) 


and then 
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Because SF V is any arbitrary but structurally stable system, 
equation (9) reduces to 


X 


W z v w j) 


+ 




(id 


for all values of v for which there are a corresponding F v and C v , 
and where y represents any arbitrary stable structure. 


Cases in Which z’s Are Independent 

A general solution of equation (ll) has_been found only for the 
case in which the z’s are independent ((z n z y ) is a diagonal matrix). 

In this case the general solution is 


F v = 


■^v,l 

My 


( 12 ) 


where 


‘w ■ 


^Xj|Hj | 2 = |M | 2 

J 



(yy) = [y | 2 
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The operators M and Zy represent minimum, phase structure s, and 
Ay. = Ay., 2 . + -^v ; 2 where A and Ay , 2 represent stable structures. 

This solution follows the general pattern of reference 1 in the fre- 
quency domain. The determination of M and is the factorization 

problem of reference 1. The function A^^ can be obtained formally 
by the following equation: 


Av,i(ia>) 


^00 

2ir 

vt=0 





u=- OD 


Ay-Ciu) e iirt du 


From equation (8), a general expression for the minimum error gives 



From equation (10 ) , the difference between nonoptimum and optimum 
errors is 




dolMSF^I 2 


(14) 


EXAMPLES 
Example 1 

The first example taken from a problem in the control of a turbo- 
jet engine is illustrated in figure 4. The engine-speed error is fed 
into the controller and a fuel-valve position signal is varied by the 
controller. Linearized engine characteristics are represented by a 
lag (ref. 6), and the fuel servo is considered as having only dead time 
(the output reproduces the input a seconds later). 


Then 


ej_ = yj_ = engine speed error 
Wq_ = Zq_ = negative of speed setting 
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, -8.10) 

E i = H i = rr^iZo 


x = signal to fuel servo 


From equation (12), since I M | ^ ^ , 

|l + 'ticn | 2 


then 


Letting 


then 


l/ 2 


M = 


1 + Ties 


A 1 = X 1 1 / 2 e a3x °z 1 


(z-jzi) = 


[b + iu>| 2 


Z ! b +- io> 


, _aico„ 

A i - x l V2 FT15 



du 


X-! 1 / 2 c e “ ab 
b + iui 


and 


Fi = -e 


■ab 


(l + Tixo) 
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From equation (5a) 


From, equation (13) 


- e~ ab (l + tIcd) 
1-6 - ab e - a:kli 


( e i 2 )opt - 4 ^ - 


-2ab' 


For the controller action derived, the responses of speed and x to 
speed setting are 


Speed = g-ab^-aios . ( B p e ed setting) 


and 


x = e -a ^(l + tLcd) • (speed setting) 

The order property and thus the derivative action of the preceding equa- 
tion indicates the large fuel flow and temperature variations encoun- 
tered with the derived controller because no limit or constraint was 
placed on these variables. 


Example 2 

The second example in which the same control problem as in exam- 
ple 1 is an a lyzed with a constraint on the mean- or integral- square 
turbine temperature variation and in which the servo lag has been 
omitted is illustrated in figure 5. For this example, 

e^_ = y^_ = engine speed error 
w x = zi = negative of speed set 
eg = turbine temperature 
w 2 = 0 


Hi = E-i = - — i-s- 

1 11 + T 1 U> 

„ 1 + cria) 

H 2 - 1 + Tin 


x = signal to fuel servo 
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From equation (12), since jM 


then 


Letting 


then 


(2 _ + ^2 I 1 + qim | 2 

|l + TiCD ^ 


+ Xg) ^ + Xg ^ 
1 + xiu 


Ai = 


+ Xg ) 1 / 2 - XgV^iQi 


(zqZl) 


|b + ioi 2 


Z l = — 


An = 


1 (h + ia>) j(X 1 + Xg) 1 / 2 - Xg 1 / 2 ^!^ 


1,1 (h + ito) (Xx + Xg) 1 / 2 + Xg^^crtT 


Fi = - 


X]_(l + Tito) 

(Xl + ^2) 1//2 + Xg 1 / 2 ^" f(Xi + X2J 1 / 2 + Xg 1 ^ 2 ^" 


From equation (5a) 


-Xq (l + Tto) 


a 
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The responses of speed and x to speed setting are 

35864 ■ [(x x 7 Tjm 7 X2 i/VL] -^ eei settiD «> 

x = - Fj_ • (speed setting) 

In all the preceding equations, only the ratio of the two \*b is 
effective. This ratio can now be set by evaluating the individual 
errors that make up equation (l5). Choosing the ratio of the X* s 
involves a compromise between temperature and speed errors, as these 
quantities vary oppositely to the ratio of X l s. 


EXPERIMENTAL RESULTS 

An axial-flow turbojet engine was operated on a sea-level static 
test stand to obtain some verification of the analysis. Figure 4 of 
example 1 describes the system. The frequency response of engine speed 
to fuel pressure obtained by harmonic analysis of transient data is 
shown in figure 6. An approximation to this data gave t = 1.6 seconds 
and a = 0.163 second. 

A proportional-plus-integral controller of the form 

was used over a range of K*s (loop gain) from 

3.5 to 11 and a range of from 1 to 2.5 seconds. The integral- 

square percentage error was obtained for each controller setting from 
the response to a step in speed setting, and the results are shown in 
figure 7. 

The smallest error (of magnitude 0.41 sec) was obtained at K = 9.3 
and =*1.6 seconds. 

The results of example 1 with b = 0 (step input) gave 



C 0 pt 


-(l + Tin>) 
! _ 6 - aia) 
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With e 


-aico 


1 aia> \ 

1 r~ih- c opt = - 1 ( x + 4X 1 - TY me - ^ deriT - 

l+o - 


2 

( . aico\ 

1 + —J 


ative action |1 + indicated was not used. For x = 1.6 seconds 

u 

and a = 0.163 second, the preceding equation indicates 

V ^ 1.6 Q QO 

K °pt - i - 0363 - 9,82 

x, , = t = 1.6 seconds 
l,opt — 

which is in substantial agreement with the data of figure 7. 


SUMMARY OF RESULTS 

An analysis was developed for the optimum controllers of general 
linear closed-multiloop systems under either stationary statistical or 
transient inputs to minimize mean- square or integral- square errors. 
General solutions were obtained for the case of independent inputs and 
one manipulated variable. Several examples of this case were shown 
for the speed control of a turbojet engine. Experimental data from a 
controlled axial-flow turbojet engine were in substantial agreement 
with the theoretical results. 

For the general multiloop systems of any number of manipulated 
variables, general solutions, which are shown in the appendix, were 
obtained for four special cases. 

Lewis Flight Propulsion Laboratory — L 

National Advisory Committee for Aeronautics 
Cleveland, Ohio, February 16, 1953 
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APPENDIX - GENERAL MULTILOOP SYSTEMS 

The scope of this analysis is the same as for the preceding analy- 
sis except that it includes any number of manipulated variables. 

Characterization of system . - The general form of the system to be 
considered is shown in figure 8. The general form of the process to be 
controlled is written as follows in matrix notation: 

y = z + E • x (16) 

The controller to be designed is to operate on the y*s in order to 
give the x's according to the operational equation 

x = C • y (17) 

or 

x = F • y + G • x (18) 

where every element of the F and G matrices represents stable 
structures. The new modes of oscillation generated by the closed loops 
are represented by the responses 

[l - G - FE]" 1 

No loss in generality Is caused by allowing 

G = - FE (19) 

and stability is now assured. There are alternate ways of building the 
same over-all operation expressed by equation (17) or (18), some of 
which may be unstable. One definitely stable method is shown in 
figure 9. 

Combining equations (16 ) , (18), and (19) gives 

x = F • z (20) 

which represents an equivalent open-loop system. An expression for the 
C of equation (l7) is 

C = (l + FE) _1 F 

Specifications on controller . - The errors and constraints are 
characterized in the same way as y. The specifications are thus 
written 


(20a) 
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= a minimum 


( 21 ) 


where 


e = w + H • x (22) 

and the elements of H are general linear operators. 

Minimization of errors . - From equations - (22) and (20), the expres- 
sion for the quantities to he minimized or constrained is 


e = w + HF • z 


and 



z 

J 


r , 


<to 


Z (SF)j T (^ 3 ) + 2) WjyC 


z v w j) 


V. J-oo 


(HF)j v (W) Jn ( Zv z n ) + (wjWj) 
v n — 

If the symbol F is used for the optimum system resulting in 
error e and the symbol F + 5F is used for any other system resulting 
in error e*, then 


Zw - 

j 







^)jn(Vv) 





Poo 


cto 


(H6F) Jv (H8r) Jn<Vn> 

V EL 
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The first two terms of the right side of the preceding equation 
are equal since the integrands are merely conjugate. The third term 
is nonnegative as it is equal to the mean-square error resulting when 
F is 8F and w = 0. Thus the necessary and sufficient condition 
for an absolute m ini mum is that 


(H5F)^ v ^(z v Wj) + * (HF) j n ( z n z v)J 


= 0 (24) 


and then 


j V j /opt j oL V n 


(25) 


Because each element of the 8F matrix is any arbitrary but structur- 
ally stable system, equation (24) reduces to 


X X J E Jr 

j 


(z v Wj) + ^ (SF) jn( z n z v) 



(26) 


for all values of r and v running over the rows and columns of F, 
and where every element of R represents any arbitrary stable structure. 

Equation (26) in matrix symbols becomes 

H'XHFZ + I'XW = R (27) 

where H 1 indicates the transpose of H and the matrices Z, W, and 
X are 

Z jv = ( z j z v) 

W jv = ^j 2 ^ 

X = diagonal (X-j_, Xg, Xj, . . .) 

The general solution of equation (27) or (26) has not been found. The 
factorization problem now seems to be that of factoring the Hermitian 
matrices (H*XH) and Z. Equation (27) has been solved for certain 
special cases. 
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Case 1 . - In the first case, H is a column matrix and the z's 
are independent. This is the case solved herein (eq. (12)) in which 
only the corresponding row of F (and C) is determined. It Is noted 
that, in general, if any row of C vanishes, then the corresponding 
row of F likewise vanishes. 

Case 2 . - In the second case, H is a diagonal matrix and the z’s 
are independent. The general solution for this case is 


where 


F 


rv 


■Ayr,l 

Etr^v 


(28) 


Avr 


H rr ( z v w r ) 

Hr*v 


l H rr | 2 - Pr | 2 
(z v z T ) = |Zy | 2 


The functions H r and Zy are minimum phase structures and 

Ayr = Ayr,l + V,2 where A^r,! and Ay^g a 1-6 stable structures. 

Case 3 . - Every element of H and H -1 is stable and the z 1 s 
are independent in the third case. The solution for this case is 


■ rv 


~z 


(H -1 ) 


rs^sv,! 


*v 


where 

( w s 

A sv - z 

v 

Zy is defined in Case 2, and A sv is to be separated into the two 
parts A S v ; i + A BV; 2 as in Case 2. 

Case 4 . - In the fourth case, Hjjj = and the z's are 

independent where BB = DjDj = 1 and every element of M and is 

stable. The solution for this case is 
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where 


■rv 


V' ^rs-^sv,l 

= " z, ^ 


A - 
A sv 




Here is defined in Case 2, and A sv is to be separated into the 

two parts A sy ^2 + A sv ^g as in Case 2. 
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Figure 1. - General linear closed-loop controlled system; one 
manipulated variable. Circle indicates operation of addition. 


Manipulated 

variable 

Engine, servo- 
motors, 
instruments, 
etc. 


I 1 



Figure 2. - Representation of general linear controlled system 
using only stable boxes 1, F, and G; one manipulated vari- 

- ' £ Vj • 

A 


able; stable if- G 
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Figure 3. - Open-loop system equivalent to closed- 



Figure 4. - Illustration of example 1, speed con- 
trol of turbojet engine. 



Figure 5. - Illustration of example 2 } speed control of turbo- 
jet engine with temperature variation constrained. 









N 
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Figure 6. - Frequency response of engine speed to fuel pressure of axial -flow 
turbojet engine. 
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0 2 4 6 8 10 12 

Loop gain, K 


Figure 7. - Integral -square errors of controlled axial -flow turbojet engine for 
range of loop gains and integral time constants. 





Figure 8. - General linear closed-loop controlled system. 








